Temporal decorrelation of collective oscillations in neural networks 
with local inhibition and long-range excitation 
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We consider two neuronal networks coupled by long-range excitatory interactions. Oscillations in 
the gamma frequency band are generated within each network by local inhibition. When long-range 
excitation is weak, these oscillations phase-lock with a phase-shift dependent on the strength of 
local inhibition. Increasing the strength of long-range excitation induces a transition to chaos via 
period-doubling or quasi-periodic scenarios. In the chaotic regime oscillatory activity undergoes 
fast temporal decorrelation. The generality of these dynamical properties is assessed in firing-rate 
models as well as in large networks of conductance-based neurons. 
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Fast synchronous gamma rhythms (30-100 Hz) are ob- 
served in the neuronal activity of cortical areas [TJ|U[31I3]. 
Modeling El [5] and experimental studies [BJ H [TU] 
suggest that these oscillations can be generated within 
local networks of GABAergic inhibitory interneurons. 

Gamma oscillatory episodes lose temporal coherence 
in several tens of milliseconds [TTJ [T^] . This decorrela- 
tion could be due to noisy extrinsic feed-forward inputs, 
but this would require substantial spatial correlations in 
their fluctuations on the scale of the circuits generating 
the rhythm. Another possibility is that damped crosscor- 
relograms arise because the network is in fact close to the 
onset of synchrony |H] . In this case temporal decorrela- 
tion is a finite size effect. Here we explore an alternative 
mechanism in which the decoherence of gamma oscilla- 
tions emerges as a collective phenomenon. 

We study a model of a small piece of cortex (2-6 mm^) 
which consists of two local networks representing two 
cortical columns |13j . Each network comprises one in- 
hibitory and one excitatory population of neurons. Oscil- 
lations are induced independently within each network by 
inhibitory to inhibitory interactions [5J [T3] . The two net- 
works interact via their excitatory populations, as con- 
sistent with anatomical evidences that excitation has a 
larger spread than inhibition [T3 [TB]. We show below, 
in both firing-rate and conductance-based models, that 
when this long-range excitation is sufficiently strong, the 
activity of the whole system displays synchronous but 
highly irregular oscillations with fast temporal decorre- 
lation. This decorrelation of the rhythmic activity is as- 
sociated with the emergence of stable chaotic attractors. 

We start by a simplified model in which the activity 
of each excitatory and inhibitory population is described 
by a firing-rate variable: 

T^rnlS) = -<2(i) + * [hia + S'''' ml^{t - D) 

rMaW = -<2(i) + * K2 + S'' ml^it - D) 
+S^^ ml^{t -D) + L^^ ml^it - D)] 



where mf, a = E,I and i = 1,2, are the activities of 
population a in the local network i and hf are exter- 
nal driving currents, constant in time. The interaction 
between populations a and /? within a local network is 
denoted by S*"*^ and the interaction between the two net- 
works by L"^ > (a, /3 = /). The delays D and D (in 
the intra- and inter-network interactions, respectively) 
represent synaptic and conduction delays. We choose 
a threshold- linear transfer function <i>[a;] = = x if 
X > 0, otherwise. For simplicity we take — Tj — I, 
hf,2 = M,2 = S"' = S", = S'"" and 

L^^ = L^^. Hence, in any attractor of the dynamics 
mf — mj = mi. The equations ([ij then reduce to: 

+ Kq mi,2(t -D) + Ki m2,i{t - D)] + 

where Ka = S*" + S^^ and Ki = L'^ > Q. Now 
the model describes two effective populations with a lo- 
cal (intra-population) interaction Kq and a long-range 
(inter-population) interaction Ki. 

The analysis of Eq. ([2| simplifies if we assume D = D 
as we do in most of the paper. However, the results 
described below remain qualitatively valid for a broad 
range of values of D and D even ii D ^ D [23] . 

Let us first consider the dynamics of one isolated pop- 
ulation {Ki = 0). For sufficiently strong local inhibition, 
at Ko = Kg'^'iD), the fixed point, m,{t) = hea:t / {I - Kq) , 
loses stability via a Hopf bifurcation. For D 1 , 
K^'^iD) Tr/{2D). The activity, mosc{t), of the pop- 
ulation in the resulting oscillatory regime can be derived 
under certain conditions [141 129]. It is also possible, un- 
der these same conditions, to compute the phase-response 
curve Z{(j)p) = d(j)/dh, which quantifies the shift in the 
phase, (j), of the population oscillation, following a small 
current perturbation Sh applied at phase (j)p [TTJ US] • 

When the populations are weakly coupled {Ki ^ 0+), 
the oscillations in their activity become phase-locked 
with a phase-shift. At/), which can be computed by com- 
bining the expressions for mo^cit) ^^nd Z((f)) '29\. This 
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FIG. 1: Phase diagram of the two-population rate model 
{D = D = 0.1). Background color indicates positive Xmax- 
Only the discussed bifurcation lines are plotted. (*) designs 
the stable homogeneous fixed-point region, (t) a region of 
multistability not analyzed in the present paper. Inset: phase- 
shift in the weak coupling limit (Kq ~ —54.8). 



A(f) depends on the local inhibition Kq and on the delay 
D. We found that in general two regimes can be distin- 
guished as a function of Kq (see Fig. [l] inset). In the 
first regime, \K°'"={D)\ < \Ko\ < \K^{D)l the activities 
of the two populations oscillate in anti- phase (At/) — tt). 
At Kq = Kq a supercritical pitchfork bifurcation occurs 
from anti-phase locking toward out-of-phase locking. For 
\Kq\ > \Kq{D)\, two stable intermediate phase-shifts ex- 
ist, A(j) = 7r±^, 0<^<7r. Such dynamical configu- 
rations break the invariance of equations ([2| under per- 
mutation of the the populations and a leader population 
acquires a phase advance with respect to a laggard pop- 
ulation (spontaneous symmetry breaking). These two 
regimes of phase-locking persist if Ki is not too large 
(see Fig. [T|. However, when Ki increases sufficiently, 
phase-locked oscillations destabilize and a series of bifur- 
cations leads eventually to chaos. The largest Lyapunov 
exponent Xmax — evaluated by numerical integration of 
the linearized equations — in fact becomes strictly posi- 
tive (colored background in Fig.[T|). The scenario for the 
onset of chaos depends critically on the strength of local 
inhibition as we show below. 

For sufficiently strong inhibition (region Feig. in 
Fig. [TJ, chaos originates from out-of-phase locking via 
period doubling. This Feigenbaum scenario is con- 
firmed by the numerical estimations of the constants 
S ~ 4.66(9) ± 0.002 and a = 2.502(8) ± 0.0001, close 
to their universal values [TSJ [53]. The bifurcation dia- 
gram shown in Fig.|2]shows the Feigenbaum cascade and 
the chaotic regime for Kq = —500 and D — D — 0.1. 
Dots in the figure and in the inset correspond to val- 
ues of the activity at a local maxima for each population 
Remarkably, out-of-phase locking which occurs at weak- 
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FIG. 2: Period-doubling scenario (Kq = -500, D = D = 0.1). 
Bifurcation diagram for the laggard (blue) and for the leader 
populations (red). Side panels: activity traces (t units). Bot- 
tom to top: out-of-phase (Ki = 1), asymmetric {Ki = 13) 
and symmetric chaos (A'l — 30). 



coupling gives rise to asymmetric chaos, for not too large 
f^i {^1 ^ 27). This can be seen in Fig. [2] where fluctu- 
ations are considerably larger in the laggard population 
than in the leader. The leader population oscillations 
are almost periodic and can be thought of as driving the 
laggard. A very similar bifurcation sequence is found, 
indeed, if one takes the excitation between the two pop- 
ulations to be unidirectional As a matter of fact, it is 
well known that such a system can exhibit chaotic behav- 
iors |19j . As Ki increases further, an abrupt transition 
occurs to a symmetric chaotic state in which the fluctua- 
tions have comparable magnitudes in the two populations 
(see Fig. [2]). Eventually, the activity of both populations 
goes to infinity (rate instability) when the positive feed- 
back loop between them becomes exceedingly strong. 

A different scenario occurs when considering the desta- 
bilization of the anti-phase locked periodic state (see 
Fig.[lJ. The corresponding bifurcation diagram is shown 
in Fig. |3] In this scenario no symmetry breaking oc- 
curs. Quasi-periodic oscillations and eventually chaotic 
oscillations emerge as Ki increases. This is revealed by 
spectral analysis. As the excitation becomes stronger, 
two and then three incommensurate frequencies appear 
in the power spectrum. The first occurrence of Xmax > 
is associated with the sudden broadening of the Fourier 
peaks (inset of Fig.[3|. This behavior corresponds to the 
Newhouse-Ruelle-Takens quasi-periodic scenario for the 
onset of chaos 20J. As shown in Figs. [l]and|3] chaos is 
intertwined with quasi-periodic and resonant windows of 
period-doubled regular oscillations (doublets). 

We conjecture that the dynamical properties described 
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FIG. 3: Quasi-periodic scenario (Kq ~ — 50, D — D = 0.1). 
Bifurcation diagram. Inset: power spectra. Side panels: ac- 
tivity traces (r units). Bottom to top: anti-phase {Ki = 1), 
quasi-periodic {Ki = 8), chaotic {Ki = 11.8), doublets 
{Ki = 12) and chaotic doublets (Ki = 16). 



above and the destruction of coherence by long range 
excitatory interactions are in fact a general feature of 
neuronal networks in which population synchronous os- 
cillations are induced by local inhibition. We verified 
this claim in a large network model of conductance- 
based spiking neurons consisting of two populations of 
Hodgkin-Huxley type neurons 0. Interactions among 
cells within a local population are purely inhibitory. For 
simplicity, these same cells are allowed to establish exci- 
tatory inter-population connections |29j . 

The connectivity patterns are random with a proba- 
bility of connection (resp. p^) for two neurons in 
the same (resp. different) populations. Synaptic cou- 
plings are modeled as time-varying conductances (peak 
conductances g^'^ , rise and decay time ri and T2, delay d 
|29j). The parameters of the network and of the external 
tonic input are fixed in order to obtain fast synchronous 
oscillations in the gamma frequency band when p^ = 
|29j . The strength of the inter-population excitation is 
then modulated by varying p^ . The temporal decorrela- 
tion of the oscillations and the phase relation between the 
population activities are characterized by the autocorrel- 
ograms (AGs) and the crosscorrelogram (CC) of the av- 
erage neuronal voltages (F^"^) = J2j ^^"^ where vj"^ 
represents the voltage of the j—th neuron {j ~ 1, • • • , N) 
in population a = 1, 2. Results for N — 32000 are shown 
in Fig. |4] and in Fig. [s] for a strong and relatively weak 
local inhibition, respectively. 

In the case of strong local inhibition, out-of-phase os- 
cillations are observed when p^ is small (see CCs in the 
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FIG. 4: Strong local inhibition (spiking neurons): p = 0.6, 
g' = 88/xS/cm^ (other parameters in [23). Left: raster plots 
(red, leader; blue, laggard population). Right: autocorrelo- 
grams (both shown for asymmetric states) and crosscorrelo- 
grams. Bottom to top: out-of-phase [p^ = 0.01), asymmetri- 
cally {p^ = 0.10) and symmetricaUy irregular (p^ — 0.14). 



right column in Fig.|4]). For increasing p^ the oscillations 
gradually become more irregular, at first only in the lag- 
gard population and then in both populations. As a re- 
sult, the AGs of {V) become rapidly damped with decor- 
relation times on the order of tens of milliseconds (right 
column of Fig. |4] laggard in blue, leader in red). Note 
that a high degree of synchrony within each population is 
maintained even when the oscillations are irregular (AGs 
are normalized x — i'^fv) / i'^Vj))^ [2T]). 

If the local inhibition is not too strong, the oscillations 
of the two populations lock in anti-phase for small p^ . 
They gradually become more irregular when p^ is in- 
creased, but the fiuctuations are now similar in the two 
populations. Gharacteristic modulations in the envelope 
of the AGs hint at a quasi-periodic scenario for the emer- 
gence of irregular activity (see Fig. |5|. 

The sequences of raster plots displayed for increasing 
p^ in Figs. [4] and [s] reproduce the main qualitative fea- 
tures of the corresponding Figs. |2]and |3] Finally, a more 
realistic network in which each population contains sepa- 
rate excitatory and inhibitory cells, and in which excita- 
tory cells fire at lower rates than inhibitory cells, exhibit 
qualitatively similar dynamics (see [29j). 

Our combined analytical and numerical study there- 
fore suggests that large scale networks in which local 
interactions are predominantly inhibitory can exhibit 
two robust routes to synchronized chaotic states as the 
strength of long-range excitation is increased. In our 
model, oscillations are generated locally through delayed 
inhibition, leading to a stochastic synchronized state in 
which neurons fire typically less than one spike per cy- 
cle of the oscillations 18 . Our scenario is consistent with 
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FIG. 5: Weak local inhibition (spiking neurons): = 0.1, 
g' — (other parameters in [H]). Left: raster plots 

(red, first; blue, second population) . Right: autocorrelograms 
(both shown for asymmetric states) and crosscorrelograms. 
Bottom to top: anti-phase {p^ = 0.008); quasi-periodic 
(p^ = 0.017); irregular (p^ = 0.032); doublets (p^ = 0.035); 
meg ular doublets (p^ = 0.062). 



experimental observations in vivo [22'. However, other 
scenarios have been proposed in which gamma oscilla- 
tions emerge due to spike-to-spike synchrony, driven by 
mutual inhibition, or to the excitation-inhibition feed- 
back loop (see e.g. |SJ[23]). Further experimental studies 
are necessary to elucidate the mechanisms underlying the 
generation of gamma oscillations in vivo. 

Previous modeling studies have considered the role of 
long-range excitation in synchronizing the activity of dis- 
tant neuronal assemblies |2H HSJ [55]. Here, we have 
found that chaotic activity naturally emerges when the 
long-range excitation is sufficiently strong. Thus, the 
locally generated rhythmic activity undergoes temporal 
decorrelation, even though, at zero time-lag, the degree 
of synchronization between the populations increases for 
larger excitatory coupling. Such tightly synchronized fir- 
ing might be an effective way to drive the connectivity be- 
tween these populations through synaptic plasticity [37]. 
Besides, effective long range interactions between popu- 
lations of neurons in primary visual cortex may be mod- 
ulated by the spatial patterns of a visual stimulus [3H] . 
Our work predicts then stimulus-dependent decoherence 
on synchronous activity evoked in the visual cortex. 
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